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Gramian-based reachability metrics for bilinear networks 
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Abstract —This paper studies Gramian-based reachability 
metrics for bilinear control systems. In the context of complex 
networks, bilinear systems capture scenarios where an actuator 
not only can affect the state of a node but also interconnections 
among nodes. Under the assumption that the Input’s infinity 
norm is bounded by some function of the network dynamic 
matrices, we derive a Gramian-based lower bound on the 
minimum input energy required to steer the state from the 
origin to any reachable target state. This result motivates our 
study of various objects associated to the reachability Gramian 
to quantify the ease of controllability of the bilinear network: 
the minimum eigenvalue (worst-case minimum input energy to 
reach a state), the trace (average minimum input energy to 
reach a state), and its determinant (volume of the ellipsoid con¬ 
taining the reachable states using control inputs with no more 
than unit energy). We establish an increasing returns property 
of the reachability Gramian as a function of the actuators, 
which in turn allows us to derive a general lower bound on the 
reachability metrics in terms of the aggregate contribution of 
the Individual actuators. We conclude by examining the effect 
on the worst-case minimum input energy of the addition of 
bilinear inputs to dlfficult-to-control linear symmetric networks. 
We show that the bilinear networks resulting from the addition 
of either inputs at a finite number of interconnections or at all 
self loops with weight vanishing with the network scale remain 
difficult-to-control. Various examples illustrate our results. 

1. Introduction 

Complex networks such as electrical power grids, social 
networks, and transportation networks, play an increasingly 
essential part in modern society. A complex network typi¬ 
cally consists of many dynamical subsystems or nodes that 
interact with each other. An important issue is understanding 
to what extent the behavior of a large-scale, complex 
network can be affected by controlling a few selected 
components. Answering this question thoroughly would be 
of extreme value in the analysis of biological networks and 
the design of engineered networks with verifiable 
performance. Existing results focus on linear control models, 
where external control inputs can only directly affect the 
state of a node, without affecting its interactions with other 
nodes. In this paper, we are interested in taking the study of 
complex networks to the nonlinear realm, where the control 
inputs may not only affect directly node states but also 
change the interconnections among nodes in the network. 

Literature review: Controllability refers to the property of 
being able to steer the state of a dynamical system from any 
starting point to any terminal point by means of appropriate 
inputs. The controllability question in the context of 
multi-agent systems and complex networks has recently 
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sparked an increasing body of research activity. The basic 
idea is understanding to what extent the state of the entire 
network can be controlled by changing the states of some of 
its subsystems. Using graph-theoretic tools, [2] relates the 
number of control nodes necessary to ensure controllability 
of a linear control network to its degree distribution. [3] con¬ 
siders the problem of rendering a linear network controllable 
by affecting a small set of variables with an external input. 
The controllability properties of consensus-type networks are 
studied employing the algebraic properties of the network 
interconnection graph by [4] in the linear case and, more re¬ 
cently, by [5] in the nonlinear case. However, controllability 
is a binary, qualitative property that does not quantify the 
amount of effort required to steer the system to the terminal 
state. In the case of linear-time invariant systems, this has 
motivated the study of various quantitative controllability 
metrics based on the reachability Gramian^. [6] discusses 
upper and lower bounds on the minimum energy to drive a 
network state from the origin to a target state. [7] considers 
the selection of control nodes in a complex linear network to 
reduce the worst-case minimum energy for reachability. [8] 
proposes an optimal actuator placement strategy in complex 
linear networks to reduce the average minimum control 
energy over random target states. [9] considers the problem 
of minimal actuator placement in a linear network so that a 
given bound on the minimum control effort for a particular 
state transfer is satisfied while guaranteeing controllability. 

The use of linear control systems to model complex 
networks presumes that the inputs only affect node states 
and not the interconnections among them. This critical 
assumption may be too limiting for certain classes of 
complex networks. For example, in the study of effective 
connectivity in the brain, it is strongly believed [10], [11] 
that external inputs not only have an effect on brain states in 
a particular area, but can also change the strength of the 
coupling between the states of different areas in the brain. 
These observations provide motivation for our study of 
reachability metrics for complex networks modeled as 
bilinear control systems. 

Bilinear systems [12], [13], [14] are one of the simplest 
classes of nonlinear systems but can be used to represent a 
wide range of physical, chemical, economical, and biological 
systems that cannot be effectively modeled using linear 
systems. While reachability/controllability of bilinear 
systems as a binary property has been widely investigated, 
see e.g., [15], [16], [17], [18], [13] and references therein, 
few results are available for quantitative metrics. A notion of 
reachability Gramian exists for bilinear systems, but its 

'For a linear system, the reachability and the controllability Gramian are 
the same. However, this is not the case for bilinear systems. Since we only 
discuss reachability, we use the term reachability Gramian. 



relation with the input energy functional is not fully 
understood. Under some assumptions, namely that at least 
one of the coefficient matrices of the bilinear terms is 
nonsingular, that the target state x / belongs to a 
neighborhood of the origin, and that an integrability 
condition holds, [19] shows that for a continuous-time stable 
bilinear system with reachability Gramian Wc, the input 
energy required to drive the state from the origin to Xf is 
always greater than x'^W~^Xf. However, the integrability 
condition may not hold for a general continuous-time 
bilinear system, see [20], [21] for a detailed discussion. 
Instead of the integrability condition, [21] assumes that the 
reachability Gramian is diagonal and proves similar results 
for some e > 0 and Xf = eej, where ej is any canonical unit 
vector in M". However, for discrete-time bilinear systems, 
there do not exist results analogous to these. 

Statement of contributions: We study the reachability 
properties of complex networks modeled as bilinear control 
systems. Our first contribution is the study of the minimum 
input energy required to steer the system state from the 
origin to any reachable target state. Even though no 
closed-form expression exists for the optimal controller and 
its associated cost due to the nonlinear nature of bilinear 
systems, we establish a Gramian-based lower bound on the 
minimum input energy required to reach a target state, under 
the assumption that the infinity norm of the input is bounded 
by some function of the system matrices. Moreover, we show 
through a counterexample that this result does not hold in 
general if the input is not constrained and, in fact, that there 
does not exist a global positive lower bound for the ratio 
between aggregate input norm and target state norm. Our 
second contribution introduces several Gramian-based reach¬ 
ability metrics for bilinear control networks that quantify the 
worst-case and average minimum input energy over all target 
states on the unit hypersphere in the state space and the 
volume of the ellipsoid containing the reachable states using 
control inputs with no more than unit energy. We prove that 
the reachability Gramian, when viewed as a function of the 
location of the actuators, exhibits an increasing returns 
property. Building on this result, we derive a general lower 
bound on the reachability metrics in terms of the aggregate 
contribution of the individual actuators and lay out a greedy 
maximization strategy based on selecting them sequentially 
starting with the one that has the largest contribution. Our 
third and final contribution involves bilinear systems built 
from difficult to control linear networks. In particular, we 
show that a bilinear system built from such a linear system 
by adding a finite number of bilinear inputs is still difficult 
to control. We also establish that a similar result holds even 
if the bilinear input can equally affect all self loops in the 
network, with a strength that vanishes with the network 
scale. Throughout the paper, we provide numerous examples 
to illustrate the strengths and limitations of our results. 

Organization: Section II introduces discrete-time bilinear 
control systems and states the problem of interest. 
Section III details basic properties of the associated 
reachability Gramian and Section IV establishes its 
relationship with the input energy functional. Motivated by 


this result. Section V explores the problem of selecting 
actuators to maximize various Gramian-based reachability 
metrics. Section VI examines the effect that the addition of 
bilinear inputs has on the worst-case minimum input energy 
for difficult-to-control linear networks. We gather our 
conclusions and ideas for future work in Section VII. 

Notation: For a vector x € M", we use Xi to denote its 
i-th component and ||a:||oo to denote its infinity norm. For a 
matrix M G we use Mi G K" to denote its z-th 

column so that M = [Mi M 2 ■.. M^]- The vector 
generated by stacking the columns of M is 

vec(M) = [Ml M 2 ■ ■. M^]^. The spectral norm 
(maximum singular value) of M is denoted by ||M|j. For 
symmetric (square) matrices, we use Aniax(AT) to denote the 
maximum eigenvalue and M > 0 (resp. M > 0) to denote 
that M is positive definite (resp. M is positive semi definite). 
The spectral radius of M, denoted p{M), is the supremum 
among the magnitudes of its eigenvalues. The matrix M is 
Schur stable if p{M) < 1. We let 0„ and Omxn denote the 
n-vector and m x n matrix with all elements equal to zero, 
respectively. We let /„ denote the identity matrix of 
dimension n x n. Given a sequence {a;(fc)}^o 
ji < j 2 € ^> 0 ^ we use to denote the finite sequence 

{a;(ji),a;(ji + 1),... ,x(j 2 )}- We omit ji if ji = 0. We let 
diag(Gli,..., 2l„) denote the block-diagonal matrix defined 
by the matrices Finally, the symbol 0 

represents the Kronecker product of matrices. 

II. Problem Formulation 

We consider the class of discrete-time bilinear control sys¬ 
tems with state-space representation 

m 

x{k -f 1) = Ax{k) + '^^{Fjx{k) + Bj)uj{k), (1) 
i=i 

where k G Z>o is the time index, x{k) G K" is the system 
state, u{k) = [ui{k),... ,Um{k)] G is the control input 
and A, Fj G Bj G M", j G m} are the system 

matrices. When convenient, we simply refer to the bilinear 
control system (1) by {A, F, B), where F = [Fi F 2 ... Fm\ 
and B = [Bi B 2 ... Bm] - Throughout the paper, we assume 
that A is Schur stable. There is no loss of generality in letting 
the same input Uj{k) appear simultaneously in the bilinear and 
linear terms in (1). In fact, a general bilinear system 

p q 

x(k -f 1) = Ax(k) + Fjx{k)vj{k) + BjWj{k), (2) 

i=i 

with v{k) G and w{k) G M'^, can be rewritten in the form 
of (1) by defi_ning u{k) = [u^(fc) tu^(fc)]'^, F = [F 0„xn<;], 
B = [0„xp B], and m = p + q. 

The system (1) is controllable in a set S C M" if, for any 
given pair of initial and target states in S, there exists a finite 
control sequence that drives the system from one to the other. 
The notion of reachability corresponds to controllability from 
the origin, i.e., the existence of a finite control sequence that 
takes the state from the origin to an arbitrary target state in S. 
Controllability and reachability are qualitative measures of a 



system that do not precisely characterize how easy or difficult, 
in terms of control effort, it is for the system to go from 
one state to another. Our objective is to provide quantitative 
measures of the degree of reachability for the bilinear control 
system (1). Note that, unlike linear systems, the controllability 
of a bilinear system depends on its initial condition. Here, we 
focus on reachability. Formally, consider the minimum-energy 
optimal control problem for a given target state xf and a time 
horizon K G Z>o, defined by 

min{„}K-i X^^Sg\'^(k)u(k) 

s.t. (1) holds VA: = 0,...,it:-l, (3) 

a;(0) = 0„, x(K) = Xf. 

Our aim can then be formulated as seeking to characterize 
the value of the optimal solution of (3) in terms of the data 
{A, F, B) that defines the bilinear control system. 

III. Reachability Gramian 

This section introduces the notion of reachability Gramian 
for stable discrete-time bilinear systems and characterizes 
some useful properties. Our discussion sets the basis for our 
later analysis on the relationship between the reachability 
Gramian and the minimum-energy optimal control 
problem (3). 

Definition 1: (Reachability Gramian [22]). The 
reachability Gramian for a stable discrete-time bilinear 
system {A,F,B) is 

OO 

W = (4) 

where 

OO 

® V^-^{{k}\-^)) G z > 2. 

The reachability Gramian for continuous-time bilinear 

systems is defined analogously, see e.g., [23], [24]. This 
notion of reachability Gramian is widely used in model order 
reduction of bilinear systems [25], [26] and linear switched 
systems [27]. Notice that, for linear control systems (i.e., 
F = Onxnm in (1)), the reachability Gramian in (4) takes 
the form 

OO 

W = Wi=J2 A'^BB^{A^)'^, (5) 

fc=0 

which is the reachability Gramian associated to the 

corresponding discrete-time linear time-invariant system [28]. 

Throughout the paper, we assume that {A,F,B) are such 
that the series in (4) converges and the resulting matrix is 
positive definite. A sufficient condition for the latter is that 
{A,Onxnmj B) is contTollable, which in turn is equivalent to 
Wi > 0. We discuss necessary and sufficient conditions for 
the convergence of the series below in (11). 

The reachability Gramian is a solution of a generalized 
Lyapunov equation [19], [24]. The next result appears 


in [22], [21]. We provide a formal proof for the sake of 
completeness. 

Theorem 1: (Generalized Lyapunov equation). The 
reachability Gramian W satisfies the following generalized 
Lyapunov equation 

m 

AWA^ + + BB'^ = 0r,xn- (6) 

Proof: From (5), one can see that Wi satisfies 

AWiA'^ - Wi + BB^ = 0„xn- (7) 

For i > 2, we obtain 

OO 

ki 0 

OO 

= A'^^F{l^<»V^-iVl,)F^{A'^^f 

ki 0 

OO m OO 

ki—0 j — 'y 0 

OO m 

= E (E FjW^-iFf)(A'^')^. (8) 

ki—0 j — 1 

Therefore, 

m 

AW,A^ - W. + E = Onxn- (9) 

We obtain (6) by summing (7) and (9) with i ranging from 2 
to OO. ■ 

It is thus possible to obtain the reachability Gramian W by 
solving the generalized Lyapunov equation (6), which one can 
do by computing 

m 

vec(W) = (/„2 - A (g) A - ^ F, (g) Fj)-^ vec(HB^). (10) 

Moreover, [29] shows that a unique positive semi-definite so¬ 
lution W exists if and only if 

m 

p{A<S) A + '^Fj ig) Fj) < 1, (11) 

i=i 

a condition that we assume to hold throughout the paper. 

Remark 1: (Connection with mean-square stability of 
stochastic bilinear systems). Following [30], [31], consider 
the time-invariant discrete-time stochastic bilinear system 

P 9 

x{k + 1) = Ax{k) + E Fjx{k)vj{k) + E BjWj{k), (12) 
i=i i=i 

where v{k) G and w{k) G are random variables. We 
have used the form (2), which is equivalent to (1). Assume 
and are uncorrelated stationary zero-mean white 

processes satisfying 

E[u(fc)u^(j)] = IpSkj, E[w{k)w'^ (j)] = IgSkj. 

If the system is mean-square stable, then the positive 
semi-definite steady state covariance E[a;(A:)x^(fc)] satisfies 



the generalized Lyapunov equation (6). Therefore, the 
existence of the reachability Gramian is related to the mean 
square stability of the corresponding stochastic bilinear 
system (12), which is equivalent to (11). • 

To conclude this section, we show that any target state Xf 
that is reachable from the origin, a;(0) = 0„, belongs to 
Im(yV’). An analogous result is known for continuous-time 
bilinear systems [21, Theorem 3.1]. 

Proposition 1: The subspace Im(yV’) is invariant under the 
bilinear control system (1) defined by {A,F,B). 

Proof: For all v € Ker(yV’), it holds that 

m 

0 = v^Wv = v'^iAWA'^ + FjWFj + BB^)v, 

i=i 

where the last equation follows from (6). As a result, 

A'^vGKeriW), F/r;GKer(yV), B'^v = 0. 

Note that since W is symmetric, Im(yV’) = (Ker(yV’))‘^. 
Therefore, if x{k) G Im(yV’), then 

m 

x'^{k+l)v = x'^{k)A'^v+'Y^ Uj{k){x'^(k)Fj v + BJv) = 0, 

i=i 

which implies that x{k -f 1) G Im(yV’) because x{k -f 1) is 
orthogonal to all v G Ker(yV’) and the proof is complete. ■ 
Given that a;(0) = 0„ G Im(yV’), Theorem 1 implies that 
x{k) G Im(yV’) for all k G Z>o, and therefore, any target state 
Xf that is reachable from the origin belongs to Im(yV’). 

IV. Minimum input energy eor reachability 
In this section, we obtain a lower bound on the minimum 
input energy required to steer the state of a bilinear control 
system from the origin to any reachable state under the 
assumption that the input norm is upper bounded. The bound 
on the minimum input energy is a function of the 
reachability Gramian. We build on this result later to define 
reachability metrics for bilinear control systems. 

From the formulation (3) of the optimal control problem in 
Section II, the necessary optimality conditions for the solution 
lead to the following nonlinear two-point boundary- 
value problem [32] for fc = 0,... , AT — 1 

^ m 

x(k -f 1) = Ax{k) + - + Bj){Fjx{k) + Sj)p(fc), 

^ m 

Vik-l) = A^r]{k) + 2 + 

j=i 

Uj{k) = ^{Fjx{k) + Bjfvik)- (13) 

For a stable, controllable, linear time-invariant system 
{A,0nxnmjB), One can obtain analytically the optimal 
control sequence from (13), 

u*{k)=B"{A^)^-'^-^Wl],Xf, 

with associated minimum control energy 

K-l 

Y iu*{k))'^u*{k) = x^Wf^Xf > xjWf^Xf, 


where Wi^k — Ylik=o BB'^[A^)^ denotes the AT-step 
controllability Gramian of the linear time-invariant system. 
In general, the nonlinear two-point boundary-value 
problem (13) does not admit an analytical solution, which 
has motivated the use of numerical approaches such as 
successive approximations [33] and iterative methods [34]. 
Given the paper goals, we do not try to find the optimal 
control sequence but instead focus on the expression for the 
minimum control energy and, specifically, on its connection 
with the reachability Gramian. 

The next result shows how, when the infinity norm of the 
input is upper bounded by a specific function of the system 
matrices, the lower bound in (14) also holds. 

Theorem 2: (The reachability Gramian is a metric for 
reachability). For the bilinear control system (1), define 

m m 

^ A - YWA^'SF^ + F]^'SA\\ + (^{Y\\A^'i'Fj + Ff'SAWY 

j=i i=i 

"" X 1/2 

ij = l 

Tr 4 yy-1 - W~^B{B^W~^B - I^)-^B'^W~^. 

For K G Z>i, if 

m 

\\u{k)U<2-^{Y\\Fj'SF,\\Yp, (15) 

for all fc = 0,1,..., AT — 1, then 

K-l 

'Y. u^{k)u{k) > x'^{K)W~^x{K). (16) 

k=0 

Proof: We consider the Lyapunov functional 

V(x) = x'^W~^x and obtain 

V(x{k + 1)) — V{x{k)) — vF{k)u{k) 


x(k) 

T 

$ii(fc) 


x{k) 

u{k) 


$2l(fc) 

^22{k) 

ufk) 


where 

m 

= A^W-^A-W-^A Y Uj{k)FjW-^F,Ui(k) 

i,j=l 

m 

+ + FjyV-^A)uj{k) G 

i=i 

m 

$2i(fc) = B^W-^A + ^ 

$22(fc) = B^W-^B - G 

In the rest of the proof, we show that the matrix $(fc) = 
[<i>y(fc)] G < 0 under (15). First, multiplying 

the generalized Lyapunov equation (6) by the vector W~^B 
from the right-hand side, and by the vector B^yV~^ from the 
left-hand side, we obtain after some manipulation 

^22ik) = -(B'^W-^ B)-^ B'^W-^AWA'^ 

m 

+ Y < 0, 

i=i 


(14) 


(18) 



where we have used the fact that W is positive definite. 
Moreover, it follows that 

4>ll(fc) - ^2lik)^22\k)^2lik) 

m 

= ^ Uj{k)Fj^'i>FiUi{k) + A^'i>A — 

* j=i 
m 

+ + Fj 'i>A)uj{k) 

i=i 

m 

< (J2 11^"’ 'SFMu{k)\\l+Xm..{A^'SA - W-i) 

* j=i 
m 

+ + Fj^'^M-\Hk)\\oo)ln < 0, (19) 

i=i 

where the last inequality holds because of (15). Using the 
Schur complement lemma [35], (18) and (19) imply $(fc) < 0. 
Finally, summing (17) with respect to fc = 0,1,..., K— 1 and 
noting U(a;(0)) = 0, we get (16). ■ 

The sufficient condition (15) is a magnitude constraint at 
every actuator. Theorem 2 provides a reachability Gramian- 
based lower bound on the minimum input energy required to 
drive the state from the origin to any reachable state. There 
are two reasons why this bound may be conservative. First, 
instead of considering the sign of the sum over the entire time 
horizon k = 0,l,...,iT — 1, the proof’s strategy relies on 
each individual inequality 

+ l)W~^x{k + 1) — x^{k)'W~^x{k) < u^{k)u{k) 

to hold for every time step k. Second, the bounding in 
inequality (19) may introduce conservativeness. 

Remark 2: (Positivity of the input upper bound in (15)). 
From the definition of (3 in Theorem 2, it is clear that the upper 
bound in (15) on the infinity norm of the input is positive if 
and only if the matrix Q{A, F, B) = A—W~^ is negative 

definite. We have computed the upper bound for hundreds of 
randomly generated matrix tuples {A,F,B) and they all turn 
out to be positive. However, we have not been able to establish 
analytically the negative definiteness of Q in general due to its 
complex dependence on A, F, B. This fact can be established 
directly for the class of scalar bilinear systems. • 

Corollary 1: (Scalar case for Theorem 2). Consider the 
class of scalar bilinear systems {a,f,b)- 

x(k + 1) = ax{k) + fx{k)u{k) + bu{k). (20) 

lfyk = l,2,...,K, 

\u{k) + a/"^| < V+ 1, (21) 

then 

K-l 

u^{k) > W~^x^{K). 

k=0 

Proof: For a scalar bilinear system (20), we 
immediately have W = (1 — either from the 

reachability Gramian definition (4) or from the generalized 


Lyapunov equation (6). Using the Lyapunov function 
V{x) = x'^yV~^x, we obtain after some manipulation, 

V{x{k + l))-V{x(k))-u^(k) 

= —(1 — (a + fu{k)Y)'W~^x'^(k) 

+ 2h{a + fu(k))W~^u(k)x(k) — (1 — b'^W~^)u^{k) 

< -i\b\W-^\x{k)\- y/a^ + nu{k)\f < 0, (22) 

where (a) holds because of (21). By summing inequality (22) 
with respect to fc = 1, 2,..., K— 1 and noting that V (a:(0)) = 
0, the proof is complete. ■ 

We end this section with two examples to complement the 
result in Theorem 2. First, we show through a counter example 
that the inequality (16) does not hold in general if the input 
norm is unconstrained. In fact, there does not exist a global 
lower bound for 

Ek=on^ik)u(k) 

\\x{KW 

that is strictly greater than 0. 

Example 1: (There is no positive global lower bound for 
{k)u{k)/\\x{K)\f). Consider the 2-step reachability 
problem for the scalar bilinear system (a, /, 1), 

x(k + 1 ) = ax{k) + fx{k)u(k) + u{k), 

a;(0) = 0, x{2)=xf. (23) 

It is easy to obtain from (23) that 

m( 0) = (a + fu{l))-^(xf - u(l)). 

By denoting Xf = Mu{\) with M € M, we have for any 
positive scalar w, 

= (((a + /u(l))-2 - w-^)M^ - 2(a + fu{l))-^M 
+ l + (a + /u(l))"^)M^(l). 

Choosing u(l) large enough such that (a+/u(l))^ > w, there 
exists M such that 

u^(0) +u^(l) -w-^xj < 0 . 

Therefore, there exists Xf, u{0), m( 1) such that under the dy¬ 
namics (23), M^(0) -I- M^(l) < w~^xj: for any ru > 0. • 

Our second example illustrates the tightness of the Gramian- 
based lower bound (16) for the input energy functional. 

Example 2: (Tightness of the Gramian-based lower bound 
in Theorem 2). Consider the following single-input bilinear 
control system taken from [36], 

(A, /, b) : x(k -f 1) = Ax{k) + fu{k)x{k) + bu(k), (24) 

where 


■ 0 

0 

0.024 

0 

0 


■ 0.8 ■ 

1 

0 

-0.26 

0 

0 


0.6 

0 

1 

0.9 

0 

0 

, b = 

0.4 

0 

0 

0.2 

0 

-0.06 


0.2 

0 

0 

0.15 

1 

0.5 


0.5 


/ = diag(0.1,0.2,0.3,0.4,0.5). 



We use (10) to compute the reachability Gramian W as 


0.6505 

0.4572 

0.4741 

0.1945 

0.5342 

0.4572 

1.2846 

-0.4169 

-0.1165 

-0.3682 

0.4741 

-0.4169 

6.9412 

1.1619 

4.5490 

0.1945 

-0.1165 

1.1619 

0.2708 

0.9262 

0.5342 

-0.3682 

4.5490 

0.9262 

5.2681 


Inequality (15) provides an upper bound on ||u(A:)||oo, 

||M(fc)||oo < 0.0011. (25) 

Figure 1 compares the input energy functional 
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Fig. 1. Input energy vs Gramian-based lower bound. 


with the Gramian-based lower bound x^{k)yV ^x{k) for 
k < K = and an arbitrarily chosen input sequence 
{u}^~^ satisfying (25). Since the gap between the minimum 
input energy and the lower bound cannot be greater than the 
one shown in the plot, Figure 1 shows that the 
Gramian-based lower bound is a good estimate of the 
minimum input energy required to drive the state from the 
origin to another state. • 

V. Reachability metrics for bilinear networks 

The inequality (16) connecting the reachability Gramian 
and the minimum energy required to steer the system from 
the origin to an arbitrary terminal state allows us to extend 
the reachability metrics defined for complex linear systems 
in [7], [6], [8] to bilinear control systems. We therefore 
consider the minimum eigenvalue, the trace, and the 
determinant of the Gramian as reachability metrics. The 
minimum eigenvalue Amin(W) characterizes the minimum 
input energy required in the worst case to reach a state. 
Given the observation, cf. [8], that 

I{xm^\\\x\\=i}^'^^ _ tr()V“^) ^ n 

/{xgR"|||x||=i}^^ « -tr(W)’ 

the trace tr(W) characterizes the average minimum control 
energy required to reach a state. Finally, the determinant 


det(>V) reflects the volume of the ellipsoid containing the 
reachable states using inputs with no more than unit energy. 

Formally, our goal is to choose m actuators from a given 
group of M candidates (m < M) such that Amin(VV’), tr()V) 
or det()V) is maximized, depending on the specific objective 
at hand. Denoting V = {1,..., M} and S — {si,..., Sm}, 
we write this combinatorial optimization problem as 

max/(W(S')), (26) 

where / : —>• K>o can be tr(-), Amin(') or det(-). We 

use >V(S') instead of W to indicate its dependence on the 
choice of S. Similarly, we denote the input matrices B and 
F as Bs = [&S 1 • ■ • bs^] and Fs = ... Fs^], 

respectively, where bi € S for each i S V. In 

general, the optimization problem (26) is NP-hard, as we 
justify below. The next result shows that the function 
mapping S to >V(S') displays the increasing returns property. 

Theorem 3: (Increasing returns property of the function 
mapping S to W{S)). For any C £'2 C V and s G V\S 2 , 

W(S '2 U {s}) - >V(S' 2 ) > >V(5i U {s}) - >V(5'i). (27) 

Proof: Without loss of generality, we relabel the elements 
in V such that Fi = {1,..., mi}, S 2 = (1, ■ ■ ■, mi+m 2 } and 
s = mi -f m 2 + 1 with mi > 1, m 2 > 0 and mi + m 2 -f 1 < 
\V\ = M. For any S = {si,..., s^} C V, we have 

00 

Wi{S) = 

/c^O 
m 00 

= = (28) 

j— 1 k—O sGS 

which implies that 

Wi(F2U{s})-Wi( 52) = Wi(s) 

= Wi(FiU{s})-Wi(Fi). (29) 

For i > 2, using the last equation in (8) and cancelling terms 
in common, we obtain 

m{S 2 u {s}) - W,{S 2 ) - W,{Si U {s}) + W,(Fi) 

mi-hm 2 + l 00 

jlj2 = l k=0 
mi-\-m 2 00 

fU2 = l k=0 

00 

fi,f 2 eSiU{s} fc=o 

mi 00 

jld2 = i k=0 
m 2 00 

j—mi-\-l k—0 
m 2 00 

j—mi+lk—0 

> 0. 

















The proof then follows using the definition (4) of W. ■ 
Since the trace function is linear. Theorem 3 immediately 
implies that tr(yV’) is a supermodular function. For linear 
time-invariant systems, the inequality in (27) becomes an 
equality. This can be seen from the proof of Theorem 3 or 
found in [ 8 ]. Supermodularity in combinatorial optimization 
of functions over subsets is analogous to convexity in 
optimization of functions defined over Euclidean space. The 
maximization of supermodular functions under cardinality 
constraints is known to be NP-hard, but its Lagrangian dual 
and its continuous relaxation can be solved in polynomial 
time [37], which provides an upper bound on the optimal 
value. On the other hand, a lower bound on the optimal 
value follows from the following result. 

Corollary 2: For any Si C S 2 C V and S '3 C 1 ^\S' 2 , 

W(S '2 U S' 3 ) - >V(S 2 ) > W(Si U S 3 ) - W(Si). (30) 

Proof: Denote S 3 = {si,..., S| 53 |}, it follows 
immediately from (27) that for any i = 1,..., IS 3 I, 

yv’(S 2 u {si,..., Si}) - yv’(S 2 u {si,..., Si_i}) 

> W(Si U {si,..., sj) - W(Si U {si,..., s*_i}). (31) 

By summing inequality (31) with respect to i = 1,..., IS 3 I, 
we obtain (30). ■ 

Theorem 4: (Lower bound on reachability metrics). Let / : 
IR"X" be either tr, Amin or det. Then for any set S 

of m actuators 

N 

/(W(S))>^/(W(S,)), (32) 

i=l 

where Si,..., Sn is any partition of S. 

Proof: By letting Si = 0 in (30) and using the fact that 
yV’(0) = Onxn, it holds immediately that for any subset 
S C y, W{S) > X)ti i^('S'i)- This directly implies that 
^(^(S)) > X)ti ^^(^(Si)). Moreover, 

Amin(TV’(S)) = min x"’"W(S)x 
\\x\\ = l 

N 

> min x^fS^ W{Si))x 

lkll=i " 

N N 

> min a;^W(Si)a; = ^ Amin(W(Si)). 

Finally, employing the Minkowski’s determinant inequal¬ 
ity [38] (if A, B G are positive definite matrices, then 

det( 2 l + B) > det(2l) -I- det(i?)) repeatedly, we obtain 

N 

det(W(S)) > ^det(W(S,)) 

i=l 

and the proof is complete. ■ 

To maximize the lower bound in (32), one simply needs to 
compute /(yV’(s)) individually for every s G V, order the re¬ 
sults in decreasing order, and select the actuators sequentially 
starting with the one with largest value. We refer to this pro¬ 
cedure as the greedy algorithm. The following example illus¬ 
trates its performance. 


Example 3: (Controller selection via the greedy algorithm). 
Consider an augmented bilinear control system based on the 
model in Example 2, 


x{k -f 1) = Ax{k) + ''^^{Fjx{k) + Bj)uj(k), 
jes 


where A, Bq = b and Fq = / are the same as those given in 
(24). The other actuator candidates are {Fj,Bj), where Bj is 
the j-th canonical vector in for j G {1,2,3}. We let 
Fi(l,2) = Fi(2,3) = 0.02, ^ 2 ( 2 ,5) = 0.01, 
^ 2 ( 4 , 2 ) = 0.05, and ^ 3 ( 1 ,!) = 0.05, ^ 3 ( 4 , 5 ) = 0.02, with 
all the other elements in Fj being zero, for j G {1,2,3}. 
Table I shows their individual and combined contributions to 
Amin(W’(S')), tr(yV’(5')), and det(yV’(S')). We make the 
following observations: 

(i) Actuators with a large individual contribution provide 

a large combinatorial contribution. This fact suggests 
that the greedy algorithm is a sensible strategy, even 
though /(TV’(s)) can be considerably smaller 

than f{V\i(S)) for / = Amin and det. 

(ii) For / = tr, tr(yV’(s)) is a good estimate of 

tr(yV’(S')). For example. 


tr(W({0,l}))-E.e{o.i} 

tr(W({0,l})) 

_ 20.98 - 14.42 - 5.03 
“ 20.98 


tr(yV’(s)) 


= 0.073 


i.e., a relative error less than 8 %. 


As an example, for the case m = 2, the greedy algorithm will 
select {0,1}, which is the optimal choice. We have observed 
similar results for various simulations of this example with 
several sets of randomly generated {Bj,Fj). • 


VI. Addition of bilinear inputs to linear 

SYMMETRIC NETWORKS 


In this section, we examine the effect that the addition of 
bilinear inputs has on the worst-case minimum input energy 
for difficult-to-control linear networks. We begin by 
formalizing this notion. 

Definition 2: (Difficult-to-control networks). A class of 
networks is said to be difficult to control (DTC) if, for a 
fixed number of control inputs, the normalized worst-case 
minimum energy grows unbounded with the scale of the 
network, i.e.. 


lim sup inf 

n-foo {u}°°:'u(fe)6R”', 

a:(oo)=ai y 


hfP 


-G 00 , 


where a;(oo) = limfc_>oo x(k). 

For linear networks {A{n),0nxnm, B{n)), one can see 
from (14) that 


liM“f = VL(WlW)- 

x{(X)) — X f 

Therefore, if the linear network is difficult to control, this 
implies that the minimum eigenvalue of the reachability 
Gramian approaches 0 as n grows. A typical class of 



TABLE I 

Contribution of chosen sets of actuators to the Gramian-based reachability metrics. 


s 

tr(lF(5)) 

Amin(VF(S)) 

det(VF(S')) 

S 

tr ( W ( S )) 

Amin(lT(5)) 

det(VF(S)) 

|0| 

14.42 

0.027 

0.242 

{0,2} 

19.91 

0.07 

3.32 


5.03 

0.023 

0.025 

|0,3| 

18.69 

0.05 

1.13 

{2} 

4.04 

3 X 10-^ 

9 X 10- '' 

{0,1,2} 

26.50 

0.137 

46.15 

{3} 

3.03 

1.6 X 10“*’ 

4 X 10“^^ 

{0,1,3} 

25.28 

0.125 

28.68 

|0,1| 

20.98 

0.09 

11.704 

{0,2,3} 

24.19 

0.103 

8.34 


difficult-to-control linear networks is the class of stable and 
symmetric networks for which, cf. [7, Corollary 3.2], the 
worst-case minimum input energy grows exponentially with 
rate — for any choice of B{n) G whose columns are 

canonical vectors in M” (here, m is the number of control 
inputs or control nodes). 

Our first result of this section shows that difficult-to-control 
linear symmetric networks remain so after the addition of a 
finite number of bilinear inputs. 

Theorem 5: (Difficult-to-control linear symmetric networks 
remain so after granted the ability to control a finite number 
of interconnections). Consider a class of difficult-to-control 
linear symmetric networks {A{n),Onxnm, B{n)). The class 
of bilinear networks {A{n),F{n),B{n)) is also DTC if the 
number of nonzero entries in the matrix F{n) € and 

||.F('fi)||max = maxij \Fij{n)\ are uniformly bounded with 
respect to n. 

Proof: Our proof has two parts. First, we construct a 
class of bilinear control system whose trajectories include 
the trajectories of the systems {A{n), F(n), B(n)) . Second, 
we establish a correspondence between the constructed 
bilinear systems and linear control networks, and build on it 
to show that they are difficult to control. For the first step, 
let \-\nz denote the number of nonzero entries in a matrix 
and define Mp = Select matrices Fj(n) 

with \Fj{n)\nz = 1 for j G {1,..., Mp} and 

|F.(n)|„, 

i=|Fi_i(n)|„^-|-l 


for i G to}, where \Fo{n)\nz — 0 for convenience. 

Consider the bilinear system 

MfP m 

a;(fc-|-l) = A(n)x{k)-i-'^^ Fj{n)x{k)vj{k)-\-'^^ Bj{n)uj{k), 
i=i i=i 

(33) 

with state x(k) G M", inputs Uj(k),Vj{k) G M, and system 
matrices A{n), Fj{n) G M"^", Bj{n) G K". Note that, se¬ 
lecting Vj{k) = Ui{k) for j = \F,_i(n)\nz + 1, • ■ •, \Fi{n)\nz 
and i G {1,..., to} makes (33) take the form 

m 

x{k -f 1) = A(n)x{k) + (n)x{k) + Bffin))uj{k), 

which corresponds to the bilinear network 
{A{n),F{n),B{n)). This implies that the optimal control 
sequence {m*}°° for {A{n),F(n),B{n)) generates the same 
network state trajectory as the (not necessarily optimal) 
control sequence {u*,u*}°° for (33). 


Our second step establishes that the bilinear network 
in (33) is difficult to control. Assume that the nonzero entry 
in Fj(n) is in the i-th row. Then, there exist Mp scalar 
sequences {uj(k)} such that for all j G {1,..., Mp} and all 
k G ^> 0 ? 

Fj{n)x{k)vj{k) = BjUj{k), (34) 

where 13j = Ci is the i-th canonical unit vector in M". 
Substituting this into (33), we obtain 

Mf m 

a;(fc-|-l) = A{n)x{k) + ''^2BjUj{k) + ''^^Bj{n)uj{k), (35) 
i=i i=i 

which is linear, symmetric and difficult to control because its 
number of control nodes is at most m-\-Mp, which is constant. 
Furthermore, there exists a constant X G M>o, such that for 
all i = l,...,n, and all k G Z>o, ||xi(fc)|| < X since the 
state trajectory starts at the origin, the network is stable and 
the input is bounded. As a result. 


sup inf ||{m,u}“|| \\xf\\ 


-2 


(34) 

> 


sup inf (||M“f+||F|| 

equation (35) 


> min(l, ) 


sup 


inf (||M° 


Xf&f 


equation (35) 








which implies the result. ■ 

Our next result shows that difficult-to-control linear 
symmetric networks might remain so even after relaxing the 
finiteness of the number of interconnections that can be 
affected by the addition of bilinear inputs. More concretely, 
we study the reachability properties of the class of networks 
{A,F,B) with symmetric adjacency matrices A = and 
F = aln, |tr(F)| < ffin) G o(y/n) (without loss of 
generality, we let a > 0). For instance, this corresponds to 
the case when a central controller can affect the strengths of 
the self-loops of all agents simultaneously in a linear 
symmetric network or when all agents simultaneously adjust 
the strength of their self-loops by the same amount. 

Theorem 6: (Worst-case control energy for linear 
symmetric networks with self-loop modulation). Consider the 
class of bilinear networks given by 

m 

x{k -f 1) = (A -f av(k)In)x(k) + E Bjuffik), 

i=i 

with A = A"^, |tr(a/„)| < p(n) G o{^/n) and 

p{A) < \/l- where - 1. Then the 




reachability Gramian of the network satisfies, for any Taking norms and upper bounding, we get 


n > m ^/x^(n), 

(36, 

Proof: Define sum(fc, i) = ki-\ -h/ci for fc € {Z>o}°° 

and i G Z>i. By definition of the reachability Gramian (4), it 
follows that 

OO 

Wi = a2(3-i) E j^sum(k,i) jsum(k,i) 

ki ,...,ki—0 

= m,s+m,f, 

where 

sum(k,i)<Tm 

ki,...,ki—0 

swLn(k,i)>Tjn 

A q, 2(3-1) ^sum(k,i)^^Ti^j^Tyum(k,z)^ 

ki,...,ki—0 

Therefore, 

OO OO 

Amin (W) = Amin ( E + E 

OO OO OO 

< Amin(E>^^^) +Ell^^/li ^ Ell^^/ll> 


i=l 


i=l 


i=l 


where the first inequality follows from the Bauer-Fike 
theorem [38] and the second inequality follows by noting 
that singular because its column space is 

contained in the space spanned by {B, AB,..., 
whose dimension is smaller than n by definition of T^. We 
can write Wi,/ in a recursive manner as follows, 

OO sum(fc,'i— 1 )>T^ 

= a2(3-l) ^ ^sum(fc,*-l)^ 

ki—0 ki ,...,ki-i—0 

T„-l OO sum(fe,i-l)=i 

+ E E ( E 

j—0 ki—Tm—j ki,...,ki-i—0 

OO 

ki^O 

Trr,-1 

i=o 

where r]{N, M) is the number of ways of choosing N G Z>o 
non-negative integers such that their sum equals M G Z>o. 
Two properties of this function are useful to us: (i) r]{N, M) = 
l,j) and (ii) ri{N,M) is an increasing function 
of N and M. Using (i), we obtain 


l!W,,/|| < ^-^||W._ij||+a 2 F-i)^(*,rm-l)||Wi,/| 

Using this inequality repeatedly, we obtain 

liw^/ll < E - i)l!Wi./ll 


i=o 


{i-\\A\\^y 


-0 


< (rma 2 )(*-i)||Wij|| - Pf) 

J =0 

where we have used ? 7 (iV, M) < (M-l-l)p(A^—1, M) < (M+ 
M) = {M + 1)^“^, which follows from properties 
(i) and (ii) of r] above. Since A is symmetric and Schur stable, 
Pll = p(A), which together with p{A) < \/l — Tm^ implies 
r“^(l — P|p)“^ < 1. Therefore, we conclude 

Combining (37) with (38), we obtain 

(rmP)(*-i)|iWij|| 


1W../II < 


(38) 


Amin(W) < ^ 


P^l-Tp(l-p 2 (P)-i 

= (3 ~ ^ ,, II 

where we have used the fact that | tr(F)| < p{n) implies that 
Tjnof < 1 for n > m~^pf{n). Using [7, Theorem 3.1], we 
obtain 


Amin(VV’) < 


l-Tfy{l-p^A))-^l-pyA) 
(1 - TmP)-l 2T, 




l-p 2 (P-T, 

and the proof is complete. ■ 

Note that, for a large-scale network with a fixed number 
of control nodes, the assumption that p{A ) < yr - Tm^ in 
Theorem 6 is not restrictive because pi — becomes 
arbitrarily close to 1 as n increases. One can show that 

l-p‘^{A)-Tr 


m in (36) is a decreasing function of n and that 




fci =0 


lim = (1 - p\A))-\ 

n^oo 1 _ p'^(A) - Tm 

Thus, Amin(VV’) decreases at least exponentially as n in¬ 
creases, which means the worst-case control energy increases 
exponentially, as indicated by Theorem 2. Therefore 
Theorem 6 can be interpreted as saying that bounded 
homogeneous self-loop modulation through bilinear inputs 
does not make a linear symmetric network easier to control. 

We illustrate the result in Theorem 6 with an example. 

Example 4: (Line network with self-loop modulation). 
Consider the group of line networks for n G {1,...,15} 
with adjacency matrices A = [a^j, where a^- = 0.25 if 
\i — j\ < 1 and = 0 otherwise for i,j G {1, ■ • ■ ,n}. Let 
m = 3, with Bi,B 2 ,B 3 being canonical vectors chosen 
optimally using exhaustive search to maximize Aniin(VV’), 
and let |tr(a/„)| = 0.9. The minimum eigenvalue of the 



reachability Gramian is plotted in a logarithmic scale in 
Figure 2 as a function of n. It can be seen that Amin(W) 
decreases exponentially as n increases, which implies that 
the worst-case control energy increases exponentially with 
the scale of the network, even with self-loop modulation. • 



Fig. 2. For the class of line networks described in Example 4, 
l^^gioC^minCVV)) is plotted in red diamonds as the scale n of the network 
increases from 1 to 15. The same quantity is also plotted in blue circles for 
the case without self-loop modulation {F = Onxn)- As predicted by Theo¬ 
rem 6, symmetric networks with or without self-loop modulation are difficult 
to control with a fixed number of control nodes. 

We conclude this section with an example that shows that a 
difficult-to-control linear network can be made easy to control 
by adding a single bilinear input that affects an infinite number 
of interconnections with strength that is independent of the 
scale of the network. 

Example 5: (Linear symmetric line network with 
n-dependent interconnection modulation). Consider the 
group of bilinear networks {A{n),F(^n),B{n)) with 



Fig. 3. The class of linear networks (A, 0„xnm, B) are difficult to control 
while the con'esponding bilinear networks {A, F, B) are easy to control. 

by some function of the system matrices, then the required 
minimum input energy can be lower bounded in terms of the 
reachability Gramian. We have studied the supermodularity 
properties of Gramian as a function of the actuators and 
derived lower bounds on the reachability metrics in terms of 
the aggregate contribution of the individual actuators. Finally, 
we have studied the effect that the addition of bilinear inputs 
has on the difficult-to-control character of linear symmetric 
networks. Future work will include the design of algorithms 
for optimal selection of control nodes in complex networks, 
where both the nodes and the interconnection strength among 
neighboring nodes can be affected by actuators, the study of 
the more general problem of steering the network state from 
an arbitrary initial condition to an arbitrary target state, and 
the analysis of observability metrics for bilinear control 
systems based on the generalized observability Gramian. 
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and F{n) = [fij] with = 1 if i = j -f 1 and all the other 
entries 0. Figure 3 compares Ainin(Wi) of the linear line 
network {A{n),0nxnm, B{n)) with Aniin(W) of the bilinear 
network {A{n),F{n),B[n)). One can see that A„iin(Wi) de¬ 
creases exponentially as the scale n of the network increases, 
which implies that the linear network is difficult to control. 
By employing the bilinear control through F{n), Aniin(W) is 
kept constant as n increases. Note that the number of 
interconnections we need to modulate increases with n. • 

VII. Conclusions 

We have proposed Gramian-based reachability metrics for 
discrete-time bilinear control networks to quantify the input 
energy required to steer the state from the origin to an 
arbitrary point. Our reachability notions build on the fact 
that, when the infinity norm of the input is upper bounded 
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